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< (54) Tit.e: APPARATUS AND METHODS FOR VERIFYING THE LOCATION OF AREAS OF INTEREST WITHIN A SAM- 
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(57) Abstract: An apparatus and method for verifying the location of an area of interest within a sample are disclosed. An imaging 
~ system includes an optica, system and a stage movable relative to the optical system. A computer server ,s m communication with 
he imaging system and with a review station. The imaging system is capable of spatially locating a datum mark on the sample and 
i-H determining a spatial offset value of the mark relative to a nominal position thereof. The coordinate systems of a respective one 
° offhTSi system and the review station can be standardized. The method includes locating a datum mark on the sample and 
O 2*2552 area of interes. within the sample. The method further includes determining the .ocation of the area ot interest relauve 
> to the mark. The method funher includes locating again the datum, and checking that a d.menstonal error in locaung the datum mark 
^ is less than a tolerance value to verify location of the area of interest. 
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Apparatus and Methods for Verifying the Location of Areas of Interest Within a Sample In an 

Imaging System 



Cross-Reference to Related Application 

This application incorporates herein by reference three U.S. patent applications field of 
even date herewith, namely on October 29, 1999, entitled Cytological Imaging System and 
Method, Cytological Stain Composition Including Verification Characteristic, and Cytological 
5 Stain Composition, and identified by Attorney Docket Nos. CYM-03 1 , CYM-032, and C YM- 
033, respectively, now U.S. Serial No. 09/430,1 16, U.S. Serial No. 09/430,1 17, and U.S. Serial 
No. 09/430,196, respectively. 

Field of the Invention 

The invention relates generally to apparatus and methods for verifying the location of 
10 areas of interest within a sample. In particular, the invention relates to an apparatus for verifying 
the location of areas of interest within a cytological specimen, in an automatic imaging system. 

Background 

Cytology is the branch of biology dealing with the study of the formation, structure, and 
function of cells. As applied in a laboratory setting, cytologists, cytotechnologists, and other 

1 5 medical professionals make medical diagnoses of a patient' s condition based on visual 

examination of a specimen of the patient's cells. A typical cytological technique is a "Pap 
smear" test, in which cells are scraped from a woman's cervix and analyzed in order to detect the 
presence of abnormal cells, a precursor to the onset of cervical cancer. Cytological techniques 
are also used to detect abnormal cells and disease in other parts of the human body. 

20 The conventional human review process for Pap smear analysis involves the manual 

screening of microscopic samples on a slide by a cytotechnologist. The cytotechnologist 
systematically views the tens of thousands of cells on a slide, typically at low magnification, to 
identify areas of interest, which are manually marked. The pathologist then views each identified 
area at high magnification, in order to distinguish abnormal cells by comparing the size, shape, 



' BNSDOCID: <WQ 0131566A2_I_> 



WO 01/31566 



PCT/US00/41634 



' -2- 

and density of the cells located in the area against established criteria. The diagnostic Pap smear 
has suffered from a high false negative rate due to the tedium and fatigue associated with this 
exhaustive search. Because of the high false negative rate, many abnormalities remain 
undetected or are detected too late. 

5 About one third of the false negative results have been associated with screening errors. 

In order to reduce screening errors, computer imaging has been applied to the automation of Pap 
smear analysis. Pre-screening systems have been developed which sort out the potentially 
abnormal specimens from among the high number of normal specimens, so that the number of 
normal specimens requiring full human reading can be reduced. These automated pre-screening 

10 systems can, however, also cause false readings because of inaccurate readings by the systems. 

Summary of the Invention 

In accordance with a first embodiment, the invention includes a method for verifying a 
location of an area of interest within a sample including the steps of locating a datum mark on 
the sample, identifying the area of interest within the sample, determining the location of the area 
15 of interest relative to the mark, and locating again the datum. If a dimensional error in relocating 
the datum is less than a tolerance value, then the location of the area of interest is verified. The 
step of identifying the area of interest within the sample may include optically scanning the 
sample, and the tolerance value is between about ten microns and one thousand microns. 

The method may also include the steps of identifying ^plurality of areas of interest 
20 within the sample and ranking the plurality of areas of interest in an order. The sample may be a 
cytological specimen deposited on a glass slide mountable on a stage of an imaging system, with 
the areas of interest within the sample being abnormal cells. According to the method, if the 
location of the area of interest is not verified, the system rejects the sample as unreliable. 
Optionally, upon locating an area of interest, the method mat include placing a visible indicator 
25 proximate the area of interest identified within the sample. 

According to another embodiment, a method for verifying a location of an area of interest 
within a sample may include the steps of locating a datum mark on the sample, assigning a 
reference coordinate value to a location of the mark, identifying an area of interest within the 
sample, assigning a coordinate value to the location of the area of interest, and spatially locating 
30 the mark, thereby determining a spatial offset value of the mark relative to the reference 
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coordinate value, wherein the location of the area of interest is verified if the spatial offset value 
is less than a tolerance value. First locating the datum mark may be accomplished by centering 
the mark in a field of view of an optical instrument. 

The method may further include storing in memory the coordinate value of the area of 
5 interest, transferring the sample to a review station, locating the datum mark, and setting a 
coordinate system of the review station based on a location of the mark. 

Another method according to the invention for verifying a location of an area of interest 
within a cytological specimen on a slide loaded in an automated cytological imaging system 
includes the steps of placing the slide within an optical path of the imaging system, centering a 

1 0 datum mark on the slide within a field of view of the imaging system, assigning a reference 
coordinate value to a location of the mark, storing in memory the reference coordinate value, 
scanning the specimen to identify an area of interest within the specimen, centering the area of 
interest within the field of view of the imaging system, assigning a coordinate value to the area 
of interest, returning to the reference coordinate value location, spatially locating the mark a 

15 second time, and comparing the reference coordinate value to a coordinate value resulting from 
locating the mark the second time, thereby determining a spatial offset value of the mark, 
wherein the location of the area of interest is verified if the spatial offset value is less than a 
tolerance value. 

The invention also includes a device for use in an imaging system for imaging a sample, 
20 the device being a slide having an area adapted for deposition of the sample thereon and at least 
two datum marks thereon, wherein the area is bounded, at least in part, by the at least two marks. 
The sample may be a cytological specimen and a location of each of the at least two marks is 
within a predetermined tolerance value. The device may also include an indicator placed on the 
slide at a location of a region of interest within the sample area, wherein the region of interest 
25 within the sample area indicates a location of an abnormal cell. 

The invention further includes an imaging system for verifying a location of an area of 
interest within a sample, the imaging system including an optical system and a stage movable 
relative to the optical system, at least one of the optical system and the stage being operable to 
position the sample in an optical path of the optical system, wherein the imaging system is 
30 capable of spatially locating a datum mark on the sample and determining a spatial offset value 
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of the mark relative to a nominal position thereof. The sample may be a cytological specimen 
deposited on a slide. 

The invention also includes an apparatus for observing a sample and for verifying a 
location of an area of interest within the sample, the apparatus including an imaging system 
5 having a first optical system and a stage movable relative to the first optical system, at least one 
of the optical system and the stage being operable to position the sample in an optical path of the 
first optical system, a computer server in communication with the imaging system, and a 
review station in communication with the server, the review station including a second optical 
system, wherein the first and the second optical systems are operable to spatially locate a datum 
10 mark on the sample, and to standardize respective coordinate systems of the first optical system 
and the second optical system. 

Brief Description of the Drawings 

This invention is described with particularity in the appended claims. The above and 
further advantages of this invention can be better understood by referring to the following 
15 description taken in conjunction with the accompanying drawings, in which: 

FIG. 1 shows a schematic diagram of one embodiment of a slide for use in accordance 
with the present invention. 

FIG. 2 shows an overall schematic diagram of one embodiment of a system of the present 
invention. 

20 FIG. 3 is a more detailed schematic diagram of one embodiment of an apparatus of the 

present invention. 

FIG. 4 shows a schematic flow chart illustrating the steps of operation in a method, 
according to the present invention, of verifying location of areas of interest in a sample. 

Detailed Description of Invention 
25 Fig. 1 is a top view of a microscope slide 1 0 of the present invention. The slide 1 0 has a 

specimen area 12 adapted for the deposition of a sample, such as a cytological specimen 14, 
thereon. The slide 10 has toleranced dimensions and chamfered edges to facilitate handling and 
use of the slide 10 in automated calibrated equipment, such as imaging equipment. In one 
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embodiment, the slide 10 is manufactured from glass and has a width of about one inch, a length 
of about three inches, and a thickness of about 0.04 inches. 

The slide 10 has at least one datum mark 16 placed thereon, and may have two or more 
marks 16 placed thereon. The specimen area 12 may be bounded, at least in part by two marks 
5 16. The mark 16 which may be referred to alternatively as a fiducial mark, is visible in a field of 
view of an optical instrument such as a microscope or a camera of an imaging system, and can be 
used as a reference datum or for measurement calibration purposes. In one embodiment, the 
slide may contain a first, a second, and a third fiducial mark 16, which are at non-collinear points 
on the slide 10. In one embodiment, the fiducial marks 16, each have a diameter of about 0.010 
10 inches and have a location tolerance of about +/- 0.015 inches. The marks 16 may be applied to 
the slide 10 by a silk screen process. 

The bounded specimen area 12 may have an area of about one square inch. One end 1 8 
of the slide 10 may be frosted or coated to facilitate marking and identification of the specimen 
14 thereon. The frosted end 18 may have an area of about one square inch. A frosted annulus 
15 20, defining an area to where the cells are transferred, may also be provided to facilitate scanning 
of sparse specimens. Also, one corner 22 of the frosted end 18 of each slide 10 may be 
chamfered to a greater degree than the other comers to ensure proper orientation of the slide 10 
when being loaded in the imaging equipment. 

The specimen deposited on the slide 10 is preferably a cytological specimen, but may be 
20 another type of specimen. In one embodiment of the invention, the cytological specimen is 
prepared from a cervical Pap smear. The Pap smear specimen is preferably a monolayer 
preparation, in which the cervical cells are disposed on the slide in a single layer to facilitate 
imaging and analysis. Equipment for preparing the monolayer specimens is disclosed in U.S. 
Patent No. 5,143,627, the disclosure of which is incorporated herein by reference in its entirety. 

25 The slide 10 may be marked with a barcode 24, as well as indicia 26 containing 

information necessary for matching the results of an analysis with the correct patient, for 
example identification of the patient from whom the specimen on the slide was obtained, or the 
doctor that provided the slide. The slide indicia 26 may have any of a variety of forms including 
one or more alphanumeric characters. It is generally desirable to mark the slides 10 with man- 

30 readable indicia so that the cytologist examining a fixed, stained specimen can readily identify 
the specimen and associated sample from which the specimen was prepared. Further, specimens 
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are often archived and retained for extended periods. Accordingly, it is generally desirable to 
avoid using an indicia standard that may fall into disuse or become obsolete. While the slide 
indicia may be marked on an adhesive label bonded to the slide 1 0, subsequent processing such 
as fixing and staining may degrade the indicia or bond. Because specimen slides 10 are often 
5 archived in slide file drawers, it is generally desirable that the slide indicia 26 be oriented along 
the width or narrow dimension of the frosted end 18 so as to be readable without requiring 
removal of the slide 10 from the file drawer. 

Fig. 2 shows a schematic diagram of one embodiment of an apparatus 30 of the present 
invention. The apparatus 30 includes at least one image processing system 32, a computer server 
10 34, and at least one review station 36. The server 34 is in communication with both the image 
processing system 32 and the review station 36, and coordinates the operations of arid data flow 
between the image processing system 32 and the review station 36. 

Fig. 3 is a more detailed illustrative diagram of one embodiment of the image processing 
system 32 of the present invention. The image processing system 32 includes a first optical 
. 15 system 38, and a slide stage 40 movable relative thereto. The review station 36 includes a 

second optical system 44, and is connected to the image processing system 32 via the server 34. 
An internal computer system 46 controls the first optical system 38 and is in communication 
with the server 34. 

The first optical system 38 includes an electronic camera 48, such as a CCD camera 48, 
20 and a microscope 50. The microscope 50 is preferably an automated microscope. The 

automated microscope 50 may include features to provide fast, precise imaging of an area of a 
slide 10 positioned in the optical path 51 of the microscope 50, such as an autofocusing 
mechanism 54. The first optical system 38 may include one or more lens systems 52. An 
illuminator 42 may provide illumination for the specimen 14 deposited on the slide 10 and 
25 generally may illuminate the slide 1 0 from below the stage 40. 

The stage 40 transports the specimen slide 10 into and within the optical path 51 of the 
microscope 50, in response to appropriate commands from the internal computer system 46. In 
one embodiment, a robotic slide handler 64 may, upon appropriate commands from the computer 
system 46, move the specimen slide 10 from a slide-holding cassette to the movable stage 40 for 
30 imaging the cells in the specimen, and then back to the cassette after imaging. A slide holder 65 
fixedly and removably positions a slide 10 repeatedly in a precise location and orientation on the 
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stage 40. The stage 40 may be motorized, and powered by one or more stage motors 56. The 
stage 40 may be mounted upon bearings 58, which in turn are mounted to the base 59 of the 
microscope 50. In one embodiment, the stage 40 is movable in an x-y plane, as shown in FIG. 3. 

In one embodiment, an interface controller 60 in communication with the movable stage 
40 may provide precise controlled movements of the slide 10 relative to the optical path 51 and 
viewing area of the microscope 50. The interface controller 60 controls the stage motors 56 by 
converting commands from the computer system 46 into appropriate signals that cause the 
motors 56 to move the stage 40 to prescribed locations. A position encoder 62 may detect the 
precise location of the stage 40, producing to the computer system 46 pulses representative of the 
movement or location of the stage. As known in the art, these pulses may be decoded by the 
computer system 46 in order to identify the location of the stage 40 in an imaging station 
coordinate system. 

In one embodiment, the image processing system 32 includes a bar code reader 66 
positioned to view the area of a slide containing the bar code 24, once the slide 10 has been 
transported to the movable stage 40 by the robotic slide handler 64 or has been loaded manually. 
In one embodiment, the image processing system 32 includes a marker 68 that automatically 
places a dot, a mark, or other visible sign in the areas of interest within the specimen where 
potentially abnormal cells may be located. 

The review station 36 is connected to the image processing system 32 via the server 34, 
and may be remotely located. The review station 36 includes a second optical system 44. The 
second optical system 44 may include any and all features of the first optical system 38. In one 
embodiment, the second optical system 44 includes a microscope 50 that is connected to a 
movable stage and that is adapted for use by a human operator for visual inspection of the areas 
of interest identified by the image processing system 32. 

In operation, the image processing system 32 performs an initial viewing and screening 
of a slide 10 on which a cytological specimen 14 is disposed, in order to make a preliminary 
assessment of the specimen 14. The image processing system 32 identifies for subsequent 
viewing by a cytotechnologist or pathologist the locations of those areas of interest on the slide 
that potentially are most relevant. In order to prevent false negative readings in a Pap smear 
screen, the locations of areas that are identified by the image processing system 32 in this 
preliminary screening must be accurate to within an acceptable error margin. Incorrect handling 
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or positioning of the slides during the scanning process make cause errors in the locations of the 
identified areas and subsequent misreading at the review station 36. 

According to this invention, the fiducial marks 16 on the slide 10 are used to verify that 
the slide 10 has been loaded properly, as well as to verify the reliability of the locations of the 
identified areas of interest within the specimen. The slide 10, marked with two or three fiducial 
marks 16, and having a specimen 14 deposited thereon, is fixedly positioned and held on the 
movable stage 40 by the slide holder 65. Next, the automated microscope 50 searches for the 
first fiducial mark 16. Nominal locations of the fiducial marks 16 are preprogrammed into the 
computer system 46. The computer system 46 searches for the fiducial marks 16 by sending 
control signals to the interface controller 60 to move the stage 40 to the estimated location of the 
first fiducial mark 16. In response, the stage motors 56 move the stage 40, until the desired 
fiducial mark 1 6 is moved within a field of view of the microscope 50. Generally, the portion of 
the slide 10 that is viewed constitutes a field of view of the microscope 50. The first fiducial 
mark 16 may then be centered automatically within the field of view of the microscope 50, to 
account for minor errors due to tolerances and other minor errors. 

The computer system 46 may assign a reference coordinate value, for example (0,0), to 
the spatial location of the first fiducial mark, and store the reference coordinate value and stage 
location in memory. The relative position of the second fiducial mark 16 with respect to the first 
fiducial mark 16 has also been preprogrammed into the computer system 46. Therefore, once the 
position of the first fiducial mark 16 is known, the computer system 46 locates the second 
fiducial mark 16. The computer system 46 causes the motors 56 to move the stage 40 to the 
nominal location of the second fiducial mark 16, after which the second fiducial mark 16 may be 
centered automatically within the field of view of the microscope 50. The computer system 46 
assigns another reference coordinate value, for example (x_l, y_l), to the spatial location of the 
second fiducial mark, and stores the reference coordinate value in its memory. The reference 
coordinate values (0,0) and (x_l, y_l) define a two-dimensional coordinate system, with respect 
to which selected areas within the specimen 14 may subsequently be identified. In an 
embodiment where the slide 10 has more than two fiducial marks, the image processing system 
32 may look for the third fiducial mark 16, and any other fiducial mark 16 on the slide 10 and 
similarly center and record their respective locations. 
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The image processing system 32 then scans the entire specimen 14, typically containing 
tens of thousands of cells, in order to determine the potentially most relevant areas of interest 
within the sample, such as cells with excessively large and/or dark nucleii. During the scanning 
process, the computer system 46 manipulates the movable stage 40 by generating appropriate 
5 control signals that cause the motors 56 to move the stage 40 in such a way that the various areas 
of the slide 10 are positioned in the optical path 51 of the microscope 50. As the stage 40 is 
moved by the motors 56 in response to the signals from the computer system 46, the image 
viewed by the lens system 52 of the microscope 50 also is moved, so as to view another portion 
of the slide 10. The image processing system 32 scans the specimen 14 by moving the movable 
.10 stage 40, and therefore the field of view of the microscope 50, across the entire specimen 14. 
The stage 40 may be moved so that the field of view of the microscope 50 is moved across the 
entire scan area. 

The electronic camera 48 is positioned in the optical path 51 of the microscope 50, so as 
to capture an electronic image of the area of the slide 1 0 being viewed. In one embodiment, the 
15 field of view of the camera is 640 pixels in width by 480 pixels in length. Each pixel is on the 
order of about 0.74 microns. The camera 48 then feeds the electronic image to the computer 
system 46 so that the computer system 46 can perform an analysis of the cells appearing in the 
imaged area. The electronic image is preferably represented by electrical signals which can be 
processed by image processors 70 within the computer system 46. 

20 The computer system 46 performs the necessary analysis in order to determine whether 

malignant or pre-malignant cells are contained in the specimen, based upon their appearance. 
The computer system 46 may rely on feature extraction algorithms, which attempt to select and 
to measure some feature within the image, e.g., the shape or the size of the cell nucleus, or the 
density of cells within the area. For instance, an unusually large sized nucleus may indicate cell 

25 abnormality. Based on pre-programmed criteria, the computer system 46 makes an identification 
of those areas within the specimen 14 most likely to contain certain features of interest, such as 
cell abnormalities. Typically, the computer system 46 identifies between about 10 to about 30 
areas of interest within the cytological specimen, however the number of areas of interest may 
vary from 0 to 1 00 or more. 

30 Once the areas of interest have been identified, the computer system 46 ranks the 

identified areas based on the degree to which each area has characteristics more likely found in a 
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typical premalignant or malignant cell than in a typical benign cell. The computer system 46 
then assigns to each identified area a coordinate value in the coordinate system defined by the 
reference coordinate values, thereby determining the relative location of each area with respect 
to the first and second fiducial points. The computer system 46 then stores in memory a file 
5 containing the coordinate values of each area of interest. The image processing system 32 also 
communicates this data with the server 34. In one embodiment, a marker 68 may place a visible 
sign on the slide at the locations of each identified area of interest to aid the pathologist in 
identifying the potentially malignant cells at the review station 36. 

In order to verify the accuracy of the locations of the identified areas of interest, the 
10 computer system 46 determines a spatial offset value of the fiducial marks 16 after the slide has 
been scanned. The computer system 46 recalls from memory the actual coordinate values for the 
first and the second fiducial marks. The computer system 46 then sends appropriate control 
signals to move the stage to a location corresponding to the measured reference coordinate value 
for the first fiducial mark, and thereafter to a second location corresponding to the measured 
15 reference coordinate value for the second fiducial mark. The computer system 46 expects the 
first fiducial mark 16 to be located at the first position, and the second fiducial mark 16 to be 
located at the second position. Because of a margin of error inherent in any mechanical system, 
the fiducial marks 16 are typically displaced by some minor spatial offset value. If the spatial 
offset value is greater than a predetermined tolerance value, either the slide moved relative to the 
20 stage during scanning, the system lost position, or some other error occurred which brings into 
question the validity of the stored locations of the identified areas of interest. Accordingly, the 
slide is rejected as being the result of an unreliable scan. In one embodiment, the tolerance value 
is in the range of about +/- 1 0 microns to about +/- 1 000 microns. 

The fiducial mark may be spatially offset for a variety of reasons. Causes for the offset 
25 may include incorrect loading or positioning of the slide in the beginning of the scanning 
process, or movements of the slide 10 relative to the movable stage 40, such as slipping or 
jarring of the slide during the scanning process. Other causes of error may include excess 
backlash in position of the movable stage during the scanning, any kind of physical manual 
intervention, or excess mechanical vibrations within the image processing system 32. 

30 If the spatial offset value is within an acceptable tolerance value, the slide is verified and 

can be accepted for further review by a cytotechnologist or a pathologist at the review station 36. 
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The above-described verification process is undertaken separately for each slide 1 0. If the 
spatial offset value of the fiducial marks 16 on the slide 10 is less than the tolerance value, the 
locations of the areas of interest are verified to be reliable within an acceptable error margin. 
The slide 10 is therefore transferred to the review station 36. 

5 In the review station 36, the once-scanned slide 10 is submitted to review by a human 

operator, who may be a cytotechnologist doing another preliminary screen for a pathologist, or 
may a pathologist doing a final screen. Either way, the image processing system 32 has 
electronically limited for the human operator the areas within the specimen at which the human 
operator needs to look. 

10 The review station 36 typically has an internal computer system that can access the server 

34, and that is connected to a microscope and a movable stage. The human operator lets the 
microscope read the bar code of the slide 10, then starts processing the slide 10 by physically 
looking for the first and the second fiducial mark on the slide 10. When the human operator 
finds the fiducial mark 16 on the slide, he centers the mark 16 within the field of view of the 

15 microscope, and sets the coordinates of the first fiducial mark 16 to (0,0). The server then 
provides the coordinates that were assigned to the areas of interest for that slide by the image 
processing system 32. 

The human operator instructs his microscope to go to the first assigned coordinate. After 
examining the area corresponding to the first assigned coordinate, the operator hits a NEXT 

20 button, which sends command signals to the microscope to go to the next assigned coordinate. 

In this manner, the operator goes through the entire range of locations that have been selected for 
review by the image processing system 30. If the human operator is a cytotechnologist, he may 
further identify certain areas if he thinks that a cell or a cluster of cells is of interest. After the 
cytotechnologist has reviewed the last location of interest, he hits the DONE button. These areas 

25 are submitted to review by a pathologist, who makes the final determination as to whether or not 
the areas of interest contain malignant cells. Alternatively, the human operator in the review 
station may be the pathologist himself, who reviews each of the areas corresponding to the 
coordinates stored in the server 34 by the image processing system 32, and makes a final 
determination for each area. After review, the review station 36 may optionally find the fiducial 

30 marks 16 again to verify that the slide did not move and no other coordinate system malfunction 
occurred during review of the slide 1 0. 
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In one embodiment, a plurality image processing systems 32 and review stations 36 may 
be in use in coordination via a common server 36. As a slide 10 is transferred from one image 
processing system 32 to another, or from one image processing system 32 to one of the plurality 
of remote stations 34, information regarding the locations of areas of interest on the slide may be 
5 stored and shared among the plurality of image processing systems 32 and review stations 36, so. 
that any of the equipment can be used interchangeably with a high degree of confidence that the 
proper areas are being reviewed by the pathologist. 

In sum, FIG. 4 illustrates in a schematic flow chart a summary of the steps of operation in 
a process for verifying location of areas of interest in a sample, according to the present 

1 0 invention. The first step includes locating a datum mark on a sample. The datum mark may a 
fiducial mark printed on a slide upon which a cytological specimen has been deposited, as 
explained earlier. The second step includes identifying an area of interest within a sample. For 
example, a specimen slide may be optically scanned by an automated microscope, in order to 
identify areas that potentially contain malignant cells. The third step includes determining the 

15 location of the area of interest relative to the datum mark. The fourth step includes locating 
again the datum mark. The fifth step includes determining whether a dimensional error in 
locating the datum mark is less than a tolerance value. If so, the sample is transferred to the 
review station, otherwise the sample is rejected. 

While the invention has been particularly shown and described with reference to specific 
20 preferred and exemplary embodiments, it should be understood by those skilled in the art that 
various changes in form and detail can be made therein without departing from the spirit and 
scope of the invention as defined by the appended claims. 
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Claims 

What is claimed is: 



1 1 A method for verifying a location of an area of interest within a sample, the method 

2 comprising the steps of: 

3 a) locating a datum mark on the sample; 

4 b) identifying the area of interest within the sample; 

5 c) determining the location of the area of interest relative to the mark; and 

6 d) locating again the datum, wherein the location of the area of interest is verified if 

7 a dimensional error in locating the datum in step d relative to step a is less than a tolerance value. 

1 2. The method of claim 1 wherein the step of identifying the area of interest within the 

2 sample comprises the step of optically scanning the sample. 

1 3. The method according to claim 1 wherein the tolerance value is between about ten 

2 microns and one thousand microns. 

1 4. The method according to claim 1 further comprising the steps of: 

2 identifying a plurality of areas of interest within the sample; and 

3 ranking the plurality of areas of interest in an order. , ;: * 

1 5. The method according to claim 1 wherein the sample comprises a cytological specimen 

2 deposited on a slide. 

1 6. The method according to claim 5 wherein the area of interest within the sample 

2 comprises an abnormal cell. 

1 7. The method according to claim 1 wherein the sample is mounted on a stage. 

18. The method according to claim 1 further comprising the step of rejecting the sample if 

2 the location of the area of interest is not verified. 

1 9. The method according to claim 1 further comprising the step of placing a visible 

2 indicator proximate the area of interest identified within the sample. 
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10. A method for verifying a location of an area of interest within a sample, the method 



2 comprising the steps of: 

3 a) locating a datum mark on the sample; 

4 b) assigning a reference coordinate value to a location of the mark; 

5 c) identifying an area of interest within the sample; 

6 d) assigning a coordinate value to the location of the area of interest; and 

7 e) spatially locating the mark, thereby determining a spatial offset value of the mark 

8 relative to the reference coordinate value; 

9 . wherein the location of the area of interest is verified if the spatial offset value is less than 
10 a tolerance value. 

1 11. The method according to claim 1 0 wherein the step of first locating the datum mark 

2 comprises the step of centering the mark in a field of view of an optical instrument. 

1 12. The method of claim 1 0 further comprising the step of storing in memory the coordinate 

2 value of the area of interest. 

1 13. The method according to claim 10 further comprising the steps of: 

2 a) transferring the sample to a review station; 

3 b) locating the datum mark; and 

4 c) setting a coordinate system of the review station based on a location of the mark. 

1 14. A method for verifying a location of an area of interest within a cytological specimen on 

2 a slide loaded in an automated cytological imaging system, the method comprising the 

3 steps of: 

4 a) placing the slide within an optical path of the imaging system; 

5 b) centering a datum mark on the slide within a field of view of the imaging system; 

6 c) assigning a reference coordinate value to a location of the mark; 
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7 d) storing in memory the reference coordinate value; 

8 e) scanning the specimen to identify an area of interest within the specimen; 

9 f) centering the area of interest within the field of view of the imaging system; 

10 g) assigning a coordinate value to the area of interest; 

11 h) returning to the reference coordinate value location; 

12 i) spatially locating the mark; and 

13 j) comparing the reference coordinate value to a coordinate value resulting from 

1 4 step i, thereby determining a spatial offset value of the mark, 

1 5 wherein the location of the area of interest is verified if the spatial offset value is less than 

16 a tolerance value . 

1 15. A device for use in an imaging system for imaging a sample, the device comprising a 

2 slide having an area adapted for deposition of the sample thereon, the slide having at least 

3 two datum marks thereon, wherein the area is bounded, at least in part, by the at least two 

4 marks. 

1 1 6. The device of claim 1 5 wherein the sample comprises a cytological specimen. 

1 17. The device of claim 1 5 wherein a location of each of the at least two marks is within a 

2 predetermined tolerance value. 

1 18. The device of claim 1 5 further comprising an indicator placed on the slide at a location of 

2 a region of interest within the sample area. 

1 19. The device of claim 1 8 wherein the region of interest within the sample area indicates a 

2 location of an abnormal cell. 

1 20. An imaging system for verifying a location of an area of interest within a sample, the 

2 imaging system comprising: 

3 a) an optical system; and 
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4 b) a stage movable relative to the optical system, at least one of the optical system 

5 and the stage being operable to position the sample in an optical path of the 

6 optical system, 

7 wherein the imaging system is capable of spatially locating a datum mark on the sample 

8 and determining a spatial offset value of the mark relative to a nominal position thereof. 

1 21 The imaging system according to claim 20 wherein the sample is a cytological specimen 

2 deposited on a slide. 

1 22. An apparatus for observing a sample and for verifying a location of an area of interest 

2 within the sample, the apparatus comprising: 

3 a) an imaging system, the imaging system comprising: 

4 i) a first optical system; and 

5 ii) a stage movable relative to the first optical system, at least one of the optical 

6 system and the stage being operable to position the sample in an optical path of 

7 the first optical system; 

8 b) a computer server in communication with the imaging system; and 

9 c) a review station in communication with the server, the review station comprising a 

10 second optical system, : 

1 1 wherein the first and the second optical systems are operable to spatially locate a datum mark on 

12 the sample, and to standardize respective coordinate systems of the first optical system and the 

13 second optical system. 
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Apparatus and Methods for Verifying the Location of Areas of Interest Within a Sample In an 

Imaging System 



Cross-Reference to Related Application 

This application incorporates herein by reference three U.S. patent applications field of 
even date herewith, namely on October 29, 1999, entitled Cytological Imaging System and 
Method, Cytological Stain Composition Including Verification Characteristic, and Cytological 
5 Stain Composition, and identified by Attorney Docket Nos. CYM-03 1 , CYM-032, and CYM- 

033, respectively, now U.S. Serial No. 09/430,1 16, U.S. Serial No. 09/430,117, and U.S. Serial 
. No. 09/430,196, respectively. 

Field of the Invention 

The invention relates generally to apparatus and methods for verifying the location of 
10 areas of interest within a sample. In particular, the invention relates to an apparatus for verifying 
the location of areas of interest within a cytological specimen, in an automatic imaging system. 

Background 

Cytology is the branch of biology dealing with the study of the formation, structure, and 
function of cells. As applied in a laboratory setting, cytologists, cytotechnologists, and other 

1 5 medical professionals make medical diagnoses of a patient's condition based on visual 

examination of a specimen of the patient's cells. A typical cytological technique is a "Pap 
smear" test, in which cells are scraped from a woman's cervix and analyzed in order to detect the 
presence of abnormal cells, a precursor to the onset of cervical cancer. Cytological techniques 
are also used to detect abnormal cells and disease in other parts of the human body. 

20 The conventional human review process for Pap smear analysis involves the manual 

screening of microscopic samples on a slide by a cytotechnologist. The cytotechnologist 
systematically views the tens of thousands of cells on a slide, typically at low magnification, to 
identify areas of interest, which are manually marked. The pathologist then views each identified 
area at high magnification, in order to distinguish abnormal cells by comparing the size, shape, 
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and density of the cells located in the area against established criteria. The diagnostic Pap smear 
has suffered from a high false negative rate due to the tedium and fatigue associated with this 
exhaustive search. Because of the high false negative rate, many abnormalities remain 
undetected or are detected too late. 

5 About one third of the false negative results have been associated with screening errors. 

In order to reduce screening errors, computer imaging has been applied to the automation of Pap 
smear analysis. Pre-screening systems have been developed which sort out the potentially 
abnormal specimens from among the high number of normal specimens, so that the number of 
normal specimens requiring full human reading can be reduced. These automated pre-screening 
10 systems can, however, also cause false readings because of inaccurate readings by the systems. 

Summary of the Invention 

In accordance with a first embodiment, the invention includes a method for verifying a 
location of an area of interest within a sample including the steps of locating a datum mark on 
the sample, identifying the area of interest within the sample, determining the location of the area 
15 of interest relative to the mark, and locating again the datum. If a dimensional error in relocating 
the datum is less than a tolerance value, then the location of the area of interest is verified. The 
step of identifying the area of interest within the sample may include optically scanning the 
sample, and the tolerance value is between about ten microns and one thousand microns. 

The method may also include the steps of identifying a plurality of areas of interest 
20 within the sample and ranking the plurality of areas of interest in an order. The sample may be a 
cytological specimen deposited on a glass slide mountable on a stage of an imaging system, with 
the areas of interest within the sample being abnormal cells. According to the method, if the 
location of the area of interest is not verified, the system rejects the sample as unreliable. 
Optionally, upon locating an area of interest, the method mat include placing a visible indicator 
25 proximate the area of interest identified within the sample. 

According to another embodiment, a method for verifying a location of an area of interest 
within a sample may include the steps of locating a datum mark on the sample, assigning a 
reference coordinate value to a location of the mark, identifying an area of interest within the 
sample, assigning a coordinate value to the location of the area of interest, and spatially locating 
30 the mark, thereby determining a spatial offset value of the mark relative to the reference 
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coordinate value, wherein the location of the area of interest is verified if the spatial offset value 
is less than a tolerance value. First locating the datum mark may be accomplished by centering 
the mark in a field of view of an optical instrument. 

The method may further include storing in memory the coordinate value of the area of 
5 interest, transferring the sample to a review station, locating the datum mark, and setting a 
coordinate system of the review station based on a location of the mark. 

Another method according to the invention for verifying a location of an area of interest 
within a cytological specimen on a slide loaded in an automated c}'tological imaging system 
includes the steps of placing the slide within an optical path of the imaging system, centering a 

1 0 datum mark on the slide within a field of view of the imaging system, assigning a reference 
coordinate value to a location of the mark, storing in memory the reference coordinate value, 
scanning the specimen to identify an area of interest within the specimen, centering the area of 
interest within the field of view of the imaging system, assigning a coordinate value to the area 
of interest, returning to the reference coordinate value location, spatially locating the mark a 

1 5 second time, and comparing the reference coordinate value to a coordinate value resulting from 
locating the mark the second time, thereby determining a spatial offset value of the mark, 
wherein the location of the area of interest is verified if the spatial offset value is less than a 
tolerance value. 

The invention also includes a device for use in an imaging system for imaging a sample, 
20 the device being a slide having an area adapted for deposition of the sample thereon and at least 
two datum marks thereon, wherein the area is bounded, at least in part, by the at least two marks. 
The sample may be a cytological specimen and a location of each of the at least two marks is 
within a predetermined tolerance value. The device may also include an indicator placed on the 
slide at a location of a region of interest within the sample area, wherein the region of interest 
25 within the sample area indicates a location of an abnormal cell. 

The invention further includes an imaging system for verifying a location of an area of 
interest within a sample, the imaging system including an optical system and a stage movable 
relative to the optical system, at least one of the optical system and the stage being operable to 
position the sample in an optical path of the optical system, wherein the imaging system is 
30 capable of spatially locating a datum mark on the sample and determining a spatial offset value 
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of the mark relative to a nominal position thereof. The sample may be a cytological specimen 
deposited on a slide. 

The invention also includes an apparatus for observing a sample and for verifying a 
location of an area of interest within the sample, the apparatus including an imaging system 

5 having a first optical system and a stage movable relative to the first optical system, at least one 
of the optical system and the stage being operable to position the sample in an optical path of the 
first optical system, a computer server in communication with the imaging system, and a 
review station in communication with the server, the review station including a second optical 
system, wherein the first and the second optical systems are operable to spatially locate a datum 

10 mark on the sample, and to standardize respective coordinate systems of the first optical system 
and the second optical system. 

Brief Description of the Drawings 

This invention is described with particularity in the appended claims. The above and 
further advantages of this invention can be better understood by referring to the following 
1 5 description taken in conjunction with the accompanying drawings, in which: 

FIG. 1 shows a schematic diagram of one embodiment of a slide for use in accordance 
with the present invention. 

FIG. 2 shows an overall schematic diagram of one embodiment of a system of the present 
invention. 

20 FIG. 3 is a more detailed schematic diagram of one embodiment of an apparatus of the 

present invention. 

FIG. 4 shows a schematic flow chart illustrating the steps of operation in a method, 
according to the present invention, of verifying location of areas of interest in a sample. 

Detailed Description of Invention 
25 Fig. 1 is a top view of a microscope slide 10 of the present invention. The slide 10 has a 

specimen area 12 adapted for the deposition of a sample, such as a cytological specimen 14, 
thereon. The slide 10 has toleranced dimensions and chamfered edges to facilitate handling and 
use of the slide 10 in automated calibrated equipment, such as imaging equipment. In one 
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embodiment, the slide 10 is manufactured from glass and has a width of about one inch, a length 
of about three inches, and a thickness of about 0.04 inches. 

The slide 10 has at least one datum mark 16 placed thereon, and may have two or more 
marks 16 placed thereon. The specimen area 12 may be bounded, at least in part by two marks 

5 1 6. The mark 1 6 which may be referred to alternatively as a fiducial mark, is visible in a field of 
view of an optical instrument such as a microscope or a camera of an imaging system, and can be 
used as a reference datum or for measurement calibration purposes. In one embodiment, the 
slide may contain a first, a second, and a third fiducial mark 1 6, which are at non-collinear points 
on the slide 10. In one embodiment, the fiducial marks 16, each have a diameter of about 0.010 

1 0 inches and have a location tolerance of about +/- 0. 0 1 5 inches. The marks 1 6 may be applied to 
the slide 10 by a silk screen process. 

The bounded specimen area 12 may have an area of about one square inch. One end 1 8 
of the slide 10 may be frosted or coated to facilitate marking and identification of the specimen 
14 thereon. The frosted end 1 8 may have an area of about one square inch. A frosted annulus 
15 20, defining an area to where the cells are transferred, may also be provided to facilitate scanning 
of sparse specimens. Also, one comer 22 of the frosted end 1 8 of each slide 1 0 may be 
chamfered to a greater degree than the other comers to ensure proper orientation of the slide 10 
when being loaded in the imaging equipment. 

The specimen deposited on the slide 10 is preferably a cytological specimen, but may be 
20 another type of specimen. In one embodiment of the invention, the cytological specimen is 
prepared from a cervical Pap smear. The Pap smear specimen is preferably a monolayer 
preparation, in which the cervical cells are disposed on the slide in a single layer to facilitate 
imaging and analysis. Equipment for preparing the monolayer specimens is disclosed in U.S. 
Patent No. 5,143,627, the disclosure of which is incorporated herein by reference in its entirety.^ 

25 The slide 1 0 may be marked with a barcode 24, as well as indicia 26 containing 

information necessary for matching the results of an analysis with the correct patient, for 
example identification of the patient from whom the specimen on the slide was obtained, or the , 
doctor that provided the slide. The slide indicia 26 may have any of a variety of forms including 
one or more alphanumeric characters. It is generally desirable to mark the slides 10 with man- 

30 readable indicia so that the cytologist examining a fixed, stained specimen can readily identify 
the specimen and associated sample from which the specimen was prepared. Further, specimens 
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are often archived and retained for extended periods. Accordingly, it is generally desirable to 
avoid using an indicia standard that may fall into disuse or become obsolete. While the slide 
indicia may be marked on an adhesive label bonded to the slide 10, subsequent processing such 
as fixing and staining may degrade the indicia or bond. Because specimen slides 1 0 are often 
5 archived in slide file drawers, it is generally desirable that the slide indicia 26 be oriented along 
the width or narrow dimension of the frosted end 18 so as to be readable without requiring 
removal of the slide 10 from the file drawer. 

Fig. 2 shows a schematic diagram of one embodiment of an apparatus 30 of the present 
invention. The apparatus 30 includes at least one image processing system 32, a computer server 
10 34, and at least one review station 36. The server 34 is in communication with both the image 
processing system 32 and the review station 36, and coordinates the operations of and data flow 
between the image processing system 32 and the review station 36. 

Fig. 3 is a more detailed illustrative diagram of one embodiment of the image processing 
system 32 of the present invention. The image processing system 32 includes a first optical 
15 system 38, and a slide stage 40 movable relative thereto. The review station 36 includes a 

second optical system 44, and is connected to the image processing system 32 via the server 34. 
An internal computer system 46 controls the first optical system 38 and is in communication 
with the server 34. 

The first optical system 38 includes an electronic camera 48, such as a CCD camera 48, 
20 and a microscope 50. The microscope 50 is preferably an automated microscope. The 

automated microscope 50 may include features to provide fast, precise imaging of an area of a 
slide 10 positioned in the optical path 51 of the microscope 50, such as an autofocusing 
mechanism 54. The first optical system 38 may include one or more lens systems 52. An 
illuminator 42 may provide illumination for the specimen 14 deposited on the slide 10 and 
25 generally may illuminate the slide 1 0 from below the stage 40. 

The stage 40 transports the specimen slide 10 into and within the optical path 51 of the 
microscope 50, in response to appropriate commands from the internal computer system 46. In 
one embodiment, a robotic slide handler 64 may, upon appropriate commands from the computer 
system 46, move the specimen slide 10 from a slide-holding cassette to the movable stage 40 for 
30 imaging the cells in the specimen, and then back to the cassette after imaging. A slide holder 65 
fixedly and removably positions a slide 10 repeatedly in a precise location and orientation on the 
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stage 40. The stage 40 may be motorized, and powered by one or more stage motors 56. The 
stage 40 may be mounted upon bearings 58, which in turn are mounted to the base 59 of the 
microscope 50. In one embodiment, the stage 40 is movable in an x-y plane, as shown in FIG. 3. 

In one embodiment, an interface controller 60 in communication with the movable stage 
5 40 may provide precise controlled movements of the slide 10 relative to the optical path 51 and 
viewing area of the microscope 50. The interface controller 60 controls the stage motors 56 by 
converting commands from the computer system 46 into appropriate signals that cause the 
motors 56 to move the stage 40 to prescribed locations. A position encoder 62 may detect the 
precise location of the stage 40, producing to the computer system 46 pulses representative of the 
10 movement or location of the stage. As known in the art, these pulses may be decoded by the 
computer system 46 in order to identify the location of the stage 40 in an imaging station 
coordinate system. 

In one embodiment, the image processing system 32 includes a bar code reader 66 
positioned to view the area of a slide containing the bar code 24, once the slide 10 has been 
15 transported to the movable stage 40 by the robotic slide handler 64 or has been loaded manually. 
In one embodiment, the image processing system 32 includes a marker 68 that automatically 
places a dot, a mark, or other visible sign in the areas of interest within the specimen where 
potentially abnormal cells may be located. 

The review station 36 is connected to the image processing system 32 via the server 34, 
20 and may be remotely located. The review station 36 includes a second optical system 44. The 
second optical system 44 may include any and all features of the first optical system 38. In one 
embodiment, the second optical system 44 includes a microscope 50 that is connected to a 
movable stage and that is adapted for use by a human operator for visual inspection of the areas 
of interest identified by the image processing system 32. 

25 In operation, the image processing system 32 performs an initial viewing and screening 

of a slide 1 0 on which a cytological specimen 14 is disposed, in order to make a preliminary 
assessment of the specimen 14. The image processing system 32 identifies for subsequent 
viewing by a cytotechnologist or pathologist the locations of those areas of interest on the slide 
that potentially are most relevant. In order to prevent false negative readings in a Pap smear 

30 screen, the locations of areas that are identified by the image processing system 32 in this 

preliminary screening must be accurate to within an acceptable error margin. Incorrect handling 
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or positioning of the slides during the scanning process make cause errors in the locations of the 
identified areas and subsequent misreading at the review station 36. 

According to this invention, the fiducial marks 16 on the slide 10 are used to verify that 
the slide 10 has been loaded properly, as well as to verify the reliability of the locations of the 

5 identified areas of interest within the specimen. Hie slide 10, marked with two or three fiducial 
marks 16, and having a specimen 14 deposited thereon, is fixedly positioned and held on the 
movable stage 40 by the slide holder 65. Next, the automated microscope 50 searches for the 
first fiducial mark 16. Nominal locations of the fiducial marks 16 are preprogrammed into the 
computer system 46. The computer system 46 searches for the fiducial marks 16 by sending 

10 control signals to the interface controller 60 to move the stage 40 to the estimated location of the 
first fiducial mark 1 6. In response, the stage motors 56 move the stage 40, until the desired 
fiducial mark 16 is moved within a field of view of the microscope 50. Generally, the portion of 
the slide 10 that is viewed constitutes a field of view of the microscope 50. The first fiducial 
mark 16 may then be centered automatically within the field of view of the microscope 50, to 

15 account for minor errors due to tolerances and other minor errors. 

The computer system 46 may assign a reference coordinate value, for example (0,0), to 
the spatial location of the first fiducial mark, and store the reference coordinate value and stage 
location in memory. The relative position of the second fiducial mark 16 with respect to the first 
fiducial mark 16 has also been preprogrammed into the computer system 46. Therefore, once the 

20 position of the first fiducial mark 16 is known, the computer system 46 locates the second 
fiducial mark 16. The computer system 46 causes the motors 56 to move the stage 40 to the 
nominal location of the second fiducial mark 16, after which the second fiducial mark 16 may be 
centered automatically within the field of view of the microscope 50. The computer system 46 
assigns another reference coordinate value, for example (x_l, y_l), to the spatial location of the 

25 second fiducial mark, and stores the reference coordinate value in its memory. The reference 

coordinate values (0,0) and (x_l, y_l) define a two-dimensional coordinate system, with respect 
to which selected areas within the specimen 14 may subsequently be identified. In an 
embodiment where the slide 10 has more than two fiducial marks, the image processing system 
32 may look for the third fiducial mark 16, and any other fiducial mark 16 on the slide 10 and 

30 similarly center and record their respective locations. 
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The image processing system 32 then scans the entire specimen 14, typically containing 
tens of thousands of cells, in order to determine the potentially most relevant areas of interest 
within the sample, such as cells with excessively large and/or dark nucleii. During the scanning 
process, the computer system 46 manipulates the movable stage 40 by generating appropriate 

5 control signals that cause the motors 56 to move the stage 40 in such a way that the various areas 
of the slide 10 are positioned in the optical path 51 of the microscope 50. As the stage 40 is 
moved by the motors 56 in response to the signals from the computer system 46, the image 
viewed by the lens system 52 of the microscope 50 also is moved, so as to view another portion 
of the slide 10. The image processing system 32 scans the specimen 14 by moving the movable 

10 stage 40, and therefore the field of view of the microscope 50, across the entire specimen 14. 
The stage 40 may be moved so that the field of view of the microscope 50 is moved across the 
entire scan area. 

The electronic camera 48 is positioned in the optical path 51 of the microscope 50, so as 
to capture an electronic image of the area of the slide 10 being viewed. In one embodiment, the 
15 field of view of the camera is 640 pixels in width by 480 pixels in length. Each pixel is on die 
order of about 0.74 microns. The camera 48 then feeds the electronic image to the computer 
system 46 so that the computer system 46 can perform an analysis of the cells appearing in the 
imaged area. The electronic image is preferably represented by electrical signals which can be 
processed by image processors 70 within the computer system 46. 

20 The computer system 46 performs the necessary analysis in order to determine whether 

malignant or pre-malignant cells are contained in the specimen, based upon their appearance. 
The computer system 46 may rely on feature extraction algorithms, which attempt to select and 
to measure some feature within the image, e.g., the shape or the size of the cell nucleus, or the 
density of cells within the area. For instance, an unusually large sized nucleus may indicate cell 

25 abnormality. Based on pre-programmed criteria, the computer system 46 makes an identification 
of those areas within the specimen 14 most likely to contain certain features of interest, such as 
cell abnormalities. Typically, the computer system 46 identifies between about 10 to about 30 
areas of interest within the cytological specimen, however the number of areas of interest may 
vary from 0 to 100 or more. 

30 Once the areas of interest have been identified, the computer system 46 ranks the 

identified areas based on the degree to which each area has characteristics more likely found in a 
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typical premalignant or malignant cell than in a typical benign cell. The computer system 46 
then assigns to each identified area a coc>rdinate value in the coordinate system defined by the 
reference coordinate values, thereby determining the relative location of each area with respect 
to the first and second fiducial points. The computer system 46 then stores in memory a file 
5 containing the coordinate values of each area of interest. The image processing system 32 also 
communicates this data with the server 34. In one embodiment, a marker 68 may place a visible 
sign on the slide at the locations of each identified area of interest to aid the pathologist in 
identifying the potentially malignant cells at the review station 36. 

In order to verify the accuracy of the locations of the identified areas of interest, the 
10 computer system 46 determines a spatial offset value of the fiducial marks 16 after the slide has 
been scanned. The computer system 46 recalls from memory the actual coordinate values for the 
first and the second fiducial marks. The computer system 46 then sends appropriate control 
signals to move the stage to a location corresponding to the measured reference coordinate value 
for the first fiducial mark, and thereafter to a second location corresponding to the measured 
15 reference coordinate value for the second fiducial mark. The computer system 46 expects the 
first fiducial mark 16 to be located at the first position, and the second fiducial mark 16 to be 
located at the second position. Because of a margin of error inherent in any mechanical system, 
the fiducial marks 16 are typically displaced by some minor spatial offset value. If the spatial 
offset value is greater than a predetermined tolerance value, either the slide moved relative to the 
20 stage during scanning, the system lost position, or some other error occurred which brings into 
question the validity of the stored locations of the identified areas of interest. Accordingly, the 
slide is rejected as being the result of an unreliable scan. In one embodiment, the tolerance value 
is in the range of about +/- 10 microns to about 47-1000 microns. 

The fiducial mark may be spatially offset for a variety of reasons. Causes for the offset 
25 may include incorrect loading or positioning of the slide in the beginning of the scanning 
process, or movements of the slide 10 relative to the movable stage 40, such as slipping or 
jarring of the slide during the scanning process. Other causes of error may include excess 
backlash in position of the movable stage during the scanning, any kind of physical manual 
intervention, or excess mechanical vibrations within the image processing system 32. 

30 If the spatial offset value is within an acceptable tolerance value, the slide is verified and 

can be accepted for further review by a cytotechnologist or a pathologist at the review station 36. 
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The above-described verification process is undertalcen separately for each slide 10. If the 
spatial offset value of the fiducial marks 16 on the slide 10 is less than the tolerance value, the 
locations of the areas of interest are verified to be reliable within an acceptable error margin. 
The slide 1 0 is therefore transferred to the review station 36. 

5 In the review station 36, the once-scanned slide 10 is submitted to review by a human 

operator, who may be a cytotechnologist doing another preliminary screen for a pathologist, or 
may a pathologist doing a final screen. Either way, the image processing system 32 has 
electronically limited for the human operator the areas within the specimen at which the human 
operator needs to look. 

10 The review station 36 typically has an internal computer system that can access the server 

34, and that is connected to a microscope and a movable stage. The human operator lets the 
microscope read the bar code of the slide 10, then starts processing the slide 10 by physically 
looking for the first and the second fiducial mark on the slide 1 0. When the human operator 
finds the fiducial mark 16 on the slide, he centers the mark 16 within the field of view of the 

1 5 microscope, and sets the coordinates of the first fiducial mark 1 6 to (0,0). The server then 
provides the coordinates that were assigned to the areas of interest for that slide by the image 
processing system 32. 

The human operator instructs his microscope to go to the first assigned coordinate. After 
examining the area corresponding to the first assigned coordinate, the operator hits a NEXT 

20 button, which sends command signals to the microscope to go to the next assigned coordinate. 

In this manner, the operator goes through the entire range of locations that have been selected for 
review by the image processing sj'stem 30. If the human operator is a cytotechnologist, he may 
further identify certain areas if he thinks that a cell or a cluster of cells is of interest. After the 
cytotechnologist has reviewed the last location of interest, he hits the DONE button. These areas 

25 are submitted to review by a pathologist, who makes the final determination as to whether or not 
the areas of interest contain malignant cells. Alternatively, the human operator in the review 
station may be the pathologist himself, who reviews each of the areas corresponding to the 
coordinates stored in the server 34 by the image processing system 32, and makes a final 
determination for each area. After review, the review station 36 may optionally find the fiducial 

30 marks 1 6 again to verify that the slide did not move and no other coordinate system malfunction 
occurred during review of the slide 10. 
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In one embodiment, a plurality image processing systems 32 and review stations 36 may 
be in use in coordination via a common server 36. As a slide 10 is transferred from one image 
processing system 32 to another, or from one image processing system 32 to one of the plurality 
of remote stations 34, information regarding the locations of areas of interest on the slide may be 
5 stored and shared among the plurality of image processing systems 32 and review stations 36, so 
that any of the equipment can be used interchangeably with a high degree of confidence that the 
proper areas are being reviewed by the pathologist. 

! 

In sum, FIG. 4 illustrates in a schematic flow chart a summary of the steps of operation in 
a process for verifying location of areas of interest in a sample, according to the present 

10 invention. The first step includes locating a datum mark on a sample. The datum mark may a 
fiducial mark printed on a slide upon which a cytological specimen has been deposited, as 
explained earlier. The second step includes identifying an area of interest within a sample. For 
example, a specimen slide may be optically scanned by an automated microscope, in order to 
identify areas that potentially contain malignant cells. The third step includes determining the 

1 5 location of the area of interest relative to the datum mark. The fourth step includes locating 
again the datum mark. The fifth step includes determining whether a dimensional error in 
locating the datum mark is less than a tolerance value. If so, the sample is transferred to the 
review station, otherwise the sample is rejected. 

While the invention has been particularly shown and described with reference to specific 
20 preferred and exemplary embodiments, it should be understood by those skilled in the art that 
various changes in form and detail can be made therein without departing from the spirit and 
scope of the invention as defined by the appended claims. 
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Claims 

What is claimed is: 



1 1 . A method for verifying a location of an area of interest within a sample, the method 

2 comprising the steps of: 

3 a) locating a datum mark on the sample; 

4 b) identifying the area of interest within the sample; 

5 c) determining the location of the area of interest relative to the mark; and 

6 d) locating again the datum, wherein the location of the area of interest is verified if 

7 a dimensional error in locating the datum in step d relative to step a is less than a tolerance value. 

1 2. The method of claim 1 wherein the step of identifying the area of interest within the 

2 sample comprises the step of optically scanning the sample. 

1 3. The method according to claim 1 wherein the tolerance value is between about ten 

2 microns and one thousand microns. 

1 4. The method according to claim 1 further comprising the steps of: 

2 identifying a plurality of areas of interest within the sample; and 

3 ranking the plurality of areas of interest in an order. 

1 5. The method according to claim 1 wherein the sample comprises a cytological specimen 

2 deposited on a slide. 

1 6. The method according to claim 5 wherein the area of interest within the sample 

2 comprises an abnormal cell. 

1 7. The method according to claim 1 wherein the sample is mounted on a stage. 

1 8. The method according to claim 1 further comprising the step of rejecting the sample if 

2 the location of the area of interest is not verified. 

1 9, The method according to claim 1 further comprising the step of placing a visible 

2 indicator proximate the area of interest identified within the sample. 
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1 10. A method for verifying a location of an area of interest within a sample, the method 

2 comprising the steps of: 

3 a) locating a datum mark on the sample; 

4 b) assigning a reference coordinate value to a location of the mark; 

5 c) identifying an area of interest within the sample; 

6 d) assigning a coordinate value to the location of the area of interest; and 

7 e) spatially locating the mark, thereby determining a spatial offset value of the mark 

8 relative to the reference coordinate value; 

9 wherein the location of the area of interest is verified if the spatial offset value is less than 
10 a tolerance value. 

1 11. The method according to claim 1 0 wherein the step of first locating the datum mark 

2 comprises the step of centering the mark in a field of view of an optical instrument. 

1 12. The method of claim 10 further comprising the step of storing in memory the coordinate 

2 value of the area of interest. 

1 13. The method according to claim 1 0 further comprising the steps of: 

2 a) transferring the sample to a review station; 

3 b) locating the datum mark; and 

4 c) setting a coordinate system of the review station based on a location of the mark. 

1 14. A method for verifying a location of an area of interest within a cytological specimen on 

2 a slide loaded in an automated cytological imaging system, the method comprising the 

3 steps of: 

4 a) placing the slide within an optical path of the imaging system; 

5 b) centering a datum mark on the slide within a field of view of the imaging system; 

6 c) assigning a reference coordinate value to a location of the mark; 
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7 d) storing in memory the reference coordinate value; 

8 e) scanning the specimen to identify an area of interest within the specimen; 

9 f) centering the area of interest within the field of view of the imaging system; 

10 g) assigning a coordinate value to the area of interest; 

11 h) returning to the reference coordinate value location; 

12 i) spatially locating the mark; and 

13 j) comparing the reference coordinate value to a coordinate value resulting from 

14 step i, thereby determining a spatial offset value of the mark, 

15 wherein the location of the area of interest is verified if the spatial offset value is less than 

16 a tolerance value. 

1 15. A device for use in an imaging system for imaging a sample, the device comprising a 

2 slide having an area adapted for deposition of the sample thereon, the slide having at least 

3 two datum marks thereon, wherein the area is bounded, at least in part, by the at least two 

4 marks. 

1 16. The device of claim 15 wherein the sample comprises a cytological specimen. 

1 17. The device of claim 1 5 wherein a location of each of the at least two marks is within a 

2 predetermined tolerance value. 

1 18. The device of claim 1 5 further comprising an indicator placed on the slide at a location of 

2 a region of interest within the sample area. 

1 19. The device of claim 1 8 wherein the region of interest within the sample area indicates a 

2 location of an abnormal cell. 

1 20. An imaging system for verifying a location of an area of interest within a sample, the 

2 imaging system comprising: 

3 a) an optical system; and 



BNSDOCID: <WO 0131566A3JA> 



WO 01/031566 



PCT/US00/41634 



-16- 

4 b) a stage movable relative to the optical system, at least one of the optical system 

5 and the stage being operable to position the sample in an optical path of the 

6 optical system, 

7 wherein the imaging system is capable of spatially locating a datum mark on the sample 

8 and determining a spatial offset value of the mark relative to a nominal position thereof. 

1 21. The imaging system according to claim 20 wherein Hie sample is a cytological specimen 

2 deposited on a slide. 

1 22. An apparatus for observing a sample and for verifying a location of an area of interest 

2 within the sample, the apparatus comprising: 

3 a) an imaging system, the imaging system comprising: 

4 i) a first optical system; and 

5 ii) a stage movable relative to the first optical system, at least one of the optical 

6 system and the stage being operable to position the sample in an optical path of 

7 the first optical system; 

8 b) a computer server in communication with the imaging system; and 

9 c) a review station in communication with the server, the review station comprising a 

10 second optical system, 

1 1 wherein the first and the second optical systems are operable to spatially locate a datum mark on 

12 the sample, and to standardize respective coordinate systems of the first optical system and the 

1 3 second optical system. 
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